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Abstract 

This paper addresses some general questions of quantum information theory 
arising from the transmission of quantum entanglement through (possibly 
noisy) quantum channels. A pure entangled state is prepared of a pair of 
systems R and Q, after which Q is subjected to a dynamical evolution given 
by the superoperator S*^. Two interesting quantities can be defined for this 
process: the entanglement fidelity Fg and the entropy production Se- It turns 
out that neither of these quantities depends in any way on the system R, but 
only on the initial state and dynamical evolution of Q. and Se are related 
to various other fidelities and entropies, and are connected by an inequality 
reminiscent of the Fano inequality of classical information theory. Some 
insight can be gained from these techniques into the security of quantum 
cryptographic protocols and the nature of quantum error-correcting codes. 



PACS numbers: 03.65Bz, 05.30.-d, 89.70. +c 
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1 Introduction 



In recent years, considerable progress has been made toward developing a 
general quantum theory of information , analogous to classical information 
theory founded by Shannon 0. Distinctively quantum- mechanical notions 
of coding and channel fidelity have been developed, and the role of 
entangled states in storing and transferring quantum information has been 
explored |^. Recently, the study of noisy quantum channels has yielded 
important new results about quantum error-correcting codes [^] and the pu- 
rification of noisy entangled states 0. 

The aim of this paper is to further clarify our understanding of noisy quan- 
tum channels by defining and exploiting new notions of fidelity and entropy 
associated with the quantum transmission process. These new quantities are 
based on an analysis of the transmission of entangled states through the noisy 
channel, although (as we shall see) the use of entanglement is not essential 
to their definition. A number of applications of these ideas will be outlined. 

Here is the general situation that we will consider. Suppose R and Q are 
two quantum systems, and Q is described by a Hilbert space Hq of finite 
dimension d. Initially the joint system RQ is prepared in a pure entangled 
state "^^^"j. The system R is dynamically isolated and has a zero internal 
Hamiltonian, while the system Q undergoes some evolution that possibly 
involves interaction with the environment E. The evolution of Q might, for 
example, represent a coding, transmission, and decoding process via some 
quantum channel for the quantum information in Q. The final state of RQ 
is possibly mixed, and is described by the density operator p^^ . 

The fidelity of this process is Fe = p^^' vl>-RQ^^ which is the prob- 

ability that the final state p^^' would pass a test checking whether it agreed 
with the initial state vl/^*^^. (This imagined test would be a measurement 
of a joint observable on RQ.) Fg measures how successfully the quantum 
channel preserves the entanglement of Q with the "reference system" R. 

We will demonstrate three important results. First, the fidelity Ff, can be 
defined entirely in terms of the initial state and evolution of the system Q. 
Furthermore, Fe < F, where F is the average fidelity when the channel carries 



one of an ensemble of pure states of Q described by p'^ = Ttr 
Thus, channels which can convey entanglement faithfully wil 
ensembles of pure states faithfully. 



also convey 
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Second, there exists a quantity Se called entropy production, also defined 
in terms of the internal properties of the system Q. This quantity can be 
viewed as the amount of information that is exchanged with the environ- 
ment during the interaction of Q and E, and it characterizes the amount of 
"quantum noise" in the evolution of Q. 

Finally, we will find an inequality (resembling the Fano inequality of clas- 
sical information theory) that bounds F^. in terms of the dimension d and 
the entropy production Se in Q. In other words, the faithfulness of Q's dy- 
namical evolution in preserving entanglement is limited by the amount of 
information that is exchanged with the environment. 

The Appendix uses some ideas from the paper to give a derivation of 
two representation theorems for trace-preserving, completely positive maps, 
which are the most general descriptions for quantum dynamical evolutions 

i- 

Throughout this paper, the systems relevant to a particular vector, opera- 
tor, or superoperator will be indicated by a superscript. Thus, ip^^ is a state 
vector for the system Q, while A^'^ is an operator acting on TIrq = Hr®Hq. 
(If no superscript is given, the quantum system is supposed to be generic.) A 
prime symbol ( ' ) denotes that a particular state or density operator arises 
as a result of some dynamical evolution. A tilde symbol ( ~ ) is usually 
present when a particular state vector or operator is not normalized, so that 
{t/j 1^) = 1, but (ip t/i) 7^ 1 in general. 



2 Channel Dynamics 
2.1 Completely positive maps 

Imagine that the system Q is prepared in an initial state and then sub- 
jected to some dynamical process, after which the state is p*^ . The dynamical 
process is described by a map so that the evolution is 

pQ ^pQ' = ^Q^pQy 

In the most general case, the map $^ must be a trace-preserving, completely 
positive linear map |^. In other words, 

• must be linear in the density operators. That is, if p'^ = PiPi +P2P2 i 
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then 



Q' 1 Q' 
PiPi +P2P2 

Pi ($^(P?))+P2 



A probabihstic mixture of inputs to $ leads to a probabihstic mixture 
of outputs. This means that must be a superoperator, that is, a 
hnear operator acting on the space of hnear operators (e.g., density 
operators) on Hq. 



$ (p*^) must be positive. 

These three conditions mean that the superoperator S*^ takes normahzed 
density operators to normahzed density operators in a reasonable way. The 
requirement of complete positivity is somewhat more subtle. 

• $^ must be completely positive. That is, suppose we extend the evo- 
lution superoperator in a trivial way to an evolution superoperator 
for a compound system RQ, yielding ® S*^, where is the identity 
superoperator on R states. Physically, this means adjoining a system R 
which has trivial dynamics (no state of R is changed) and which does 
not interact with Q. $^ is completely positive if, for all such trivial 
extensions, the resulting superoperator I'^ ® S*^ is positive. 

A completely positive map is not only a reasonable map from density op- 
erators to density operators for Q, but it is extensible in a trivial way to a 
reasonable map from density operators to density operators on any larger 
system RQ. Since we cannot exclude a priori that our system Q is in fact 
initially entangled with some distant isolated system R, any acceptable S*^ 
had better satisfy this condition. 

^We will use the term "positive" to refer generically to operators that are positive 
semi- definite — i.e., those that are Hermitian and have no negative eigenvalues. 
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2.2 Representations of $ 



Q 



Completely positive, trace-preserving linear maps obviously include all uni- 
tary evolutions of the state: p^' = U'^ p'^U'^K They also include unitary 
evolutions involving interactions with an external system. Suppose we con- 



sider an environment system E that is initially in the pure state 
we could have 



0^ 



Then 



Tr; 



0^ 



u 



where U'^^ is some arbitrary unitary evolution on the joint system QE. This 
map is also trace-preserving and completely positive. 

If we can write a superoperator as a unitary evolution on an extended 
system QE followed by a partial trace over E, we say that we have a "unitary 
representation" of the superoperator. Such a representation is not unique, 
since many different unitary operators U'^^ will lead to the same 

Another useful sort of representation for completely positive maps em- 
ploys only operators on Tiq. Let be a collection of such operators indexed 
by p. Then the map given by 



(2) 



is a completely positive map. If in addition the operators satisfy 

E<^? = 1^ (3) 



then the map is also trace-preserving. Such a representation for %^ in terms 
of operators A^ will be called an "operator-sum representation" for . A 
single will admit many different operator-sum representations. 

Some insight into the connection between these representations for %^ can 
be gained by explicitly writing down the partial trace Tr^; from Equation |l[ 



Suppose that p*^ 
states of E. Then 



and let 



/i ) be a complete orthonormal set of 



kQ 



® 



0^ 
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If we define the operator by 



then we recover an expression identical to Equation |^. Since every input 
state p*^ is a convex combination of pure states, we recover Equation for 
arbitrary by linearity. 

A pair of important representation theorems state 

I. Every trace-preserving, completely positive linear map has a unitary 

representation, as in Equation |I]. 

II. Every trace-preserving, completely positive linear map S*^ has an operator- 

sum representation, as in Equation ^ 

(By our argument above, the second statement follows from the first.) These 
statements, particularly the first, motivate us to assert that the trace-preserving, 
completely positive linear maps is exactly the class of allowed evolutions of 
a quantum system. Any reasonable evolution should be such a map; and ev- 
ery such map could be accomplished by unitary dynamics (i.e., Hamiltonian 
evolution) on a larger system. 

A relatively simple proof of both of these representation theorems is found 
in the Appendix. 

From now on we will assume that a particular has been specified, giving 
the evolution of states of the system Q. We will use unitary representations 
and operator-sum representations as convenient. 



3 Mixed States and Purifications 



3.1 Entangled states 



\^RQ\ Qf joint system RQ, we can form the reduced 



Given a pure state 
state p^ for one of the subsystems Q by means of a partial trace operation: 

pQ = Tr^k^oy^^Q 



,RQ 



R 
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where k^j is an orthonormal basis for Tin. We can define tlie reduced state 
given a mixed joint state p^^ in the same fashion. 

We have made use of a partial inner product between states of R and 
states of a larger system RQ. This is easy to understand. The vector 



Q 



0^ 



is defined to be the unique vector in Tig such that 



a 



Q 



^RQ 



for all vectors 
write this as 



a 



Q 



^ in Hq (where \(p^a^'^ = (g) a'^^) 



We could also 



for some orthonormal basis set for Hq. 

There are, of course, many different pure entangled states ^I'^'^^ that give 
rise to a given reduced state p**?. These arc gcncrically called purifications 



of p'^. Suppose ^'f'^\ and vl'"'^) are two such purifications. Then we can 



,RQ\ 



I 



write each of them using the Schmidt decomposition: 



^^^^ 



E 

EVA 



tR 

Slfe 



tR 



where the and A^^ are eigenvalues and eigenstates of p*^, and the and 

are two orthonormal sets of states in Ti^. Since the two purifications 
differ only in the choice of orthonormal set in 'H^., they are connected by a 
unitary operator of the form U^®!*^ . Any purification of p^ can be converted 
to any other by a unitary rotation acting on the auxilliary "reference" system 
R. 

The Schmidt decomposition also makes clear the fact that, given a pure 
entangled state 



A? 



the reduced states p^ = Tr^ |\E'^'3^^xi>^?Q ^nd p^ = Ttq 
have exactly the same set of non-zero eigenvalues, namely the A^ 



x^jRQX/xifRQ 



will 
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3.2 Mixed-state fidelity 

The notion of purification is used to define the fidelity between two density 
operators pi and p2- This is 

F(pi,p2) = max 1(1 |2) I' 

where the maximum is taken over all purifications |1) and |2) of pi and p2 
[|]. The fidelity has several important properties: 

• < F{pi, P2) < 1, with -F(pi, P2) = 1 if and only if pi = p2. 

• F{pi,p2) = F{p2,pi). 

• If pi = is a pure state, then 

Fipi,p2) = Trpipa = {ipi\ P2 \tpi) ■ 

This is just the probability that the state p2 would pass a measurement 
testing whether or not it is the state \ifji)- 

The fidelity is a general way of defining the "closeness" of a pair of states. 
If we have two states pf*^ and p^*^, we can form 

p? = Tr^pf^ 
p^ = Tr^p^'3. 

Then F(pf'^, p^'^) < F{pf , p^). This can be seen directly from the definition 
by noting that every purification of pf*^ is also a purification of p^ , and so 
on. 



3.3 Ensembles of pure states 

A mixed state p*^ may arise from a statistical ensemble £ of pure states ijjf 
of Q. In this case we can write 



where Pi is the probabihty of the state i/j'^) in the ensemble S. 
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If 



Tr 



R 



^RQ\I^RQ 



for a pure entangled state \1>^'5\ of we 



can "realize" an ensemble of pure states for p'^ by performing a complete 
measurement on the system R. (This and other characterizations of the 

ef) be the basis for 



ensembles described by are given in 0].) Let 
this complete measurement. Each outcome of the /^-measurement will be 



associated with a relative state |Tl[] of the system Q. If is the probability 

'^^) is the relative state of Q 



of the ith outcome of the /^-measurement and 
associated with this outcome, then 



Q 



^RQ 



(Note: In dealing with ensembles of pure states, it is sometimes useful to 



consider the non-normalized vectors 



il^il- In other words, we 



can normalize the component states in £ by their probabilities. The resulting 
vectors are in themselves a complete description of the ensemble £. See [|T0| 
for fuller details.) It follows that 



i 

TrR|^^^)(^^^ 



SO that the ensemble £ of relative states is a pure state ensemble for p^ . In 
fact, any pure state ensemble for p^ can be realized in just this way. That 
is, we can fix a particular purification for p^ and give a prescription 

for realizing any pure state ensemble for p^ as a relative state ensemble for 
some complete measurement on R. 

Let £i be a pure state ensemble for p'^ given by probabilities pi and states 
il^f^i and suppose that TIr has arbitrarily high dimension, at least as large 
as the number of distinct pure states in the ensembles we consider. Then we 
can construct a purification vl/f'^^ by 



^RQ\ 



E 



a. 



R 



where the 



a 



R 



are a basis for 7i^. (Only some of these basis vectors may 



appear in this superposition.) Clearly, p^ = Tr 



R 



Similarly, if 
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we have another ensemble for p'^ given by probabihties qi and states 
we can construct a purification 



for some other R basis 



Since both of these are purifications of the same 



p*^, there is a unitary operator such that '^^'^^ = {u^ ® l'^^ ^ff^^. 

We can clearly realize the ensemble £2 by making a measurement of the 
j3^) basis on the state of R'^ but this is equivalent to making a mea- 



surement of the basis 



Ti 



R 



u 



13 f-) on the state 



7: 



^RQ\ 



/3f I 



^1 



/3f 



Thus, the ensemble £2 can be realized by making an /^-measurement on the 
purification \E'f'^^. 

\E'^'3\ and obtain 



It follows that we could pick a particular purification 
any pure state ensemble for p'^ by a suitable choice of measurement basis for 
the system R. 

We have assumed that dimTi/j is arbitrarily large so that we can have 
an arbitrarily large number of basis vectors (since the pure state ensembles 
may have an arbitrarily large number of components). But this is not really 
necessary. If we allow positive operator measurements (POMs) on i?, 
then the dimension of Tiji need be no greater than the dimension of Tig, 
which is the minimum size necessary to purify all mixed states p^ . The 



only relevant part of the basis 



is the set of sub-normalized vectors 



-- n 
supports p 



a. 



R 



where 11 is the projection onto the subspace of Hr that 



Tr, 



^RQ\/^RQ 



Since dim TCq = d, this subspace need have 
are elements of a POM on this 



only up to d dimensions. The 

subspace. We can use this POM on the d-dimensional subspace of Hr to 
find a POM for a purification that uses another reference system R^,, with 
dimHi?, = d. 
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3.4 Entropy 

Since entropy will be of central importance for our results, we will review 
some of the relevant properties of classical and quantum entropy. 

Suppose the non-negative numbers pi,p2, ■ ■ ■ sum to unity and thus form 
a probability distribution. The Shannon entropy H(p) of this probability 
distribution (represented by the vector p) is just 

H{p) = -J^Pk'^^SPk- (4) 

k 

We specify the base of our logarithms to be 2, and take log = 0. If p forms 
the probability for some random variable X, so that p{xk) = Pk for various 
values Xk of X, then we will often write this entropy as H{X). 

The Shannon entropy H{X) is the fundamental quantity in classical in- 
formation theory, and it represents the average number of binary digits (or 
bits) required to represent the value of X f^. It can be thought of as a 
measure of the uncertainty in the value of X expressed by the probability 
distribution. We can use it to define various information-theoretic quantities, 
such as the conditional entropy 

HiX\Y) = Y.Piyk)H{X\y,) 

k 

jk 

for a joint distribution p{xj,yk) over values of two variables X and Y. A very 
important quantity is the mutual information I{X : Y) between two random 
variables X and Y: 

I{X:Y) = H{X)-H{X\Y), 

which is the average amount that the uncertainty about X decreases when 
the value of Y is known. If X represents the input of a communications 
channel and Y represents the output, then I{X : Y) represents the amount of 
information conveyed by the channel. It turns out that I{X : Y) = I{Y : X). 

The quantum mechanical definition of entropy was first given by von 
Neumann [0. Suppose p'^ is a density operator representing a mixed state 



of Q. Then the entropy is 

5(pQ) = -Trp^logp^. (5) 



11 



If Ai, A2, . • . are the eigenvalues of p*^, then S{p'°^) = H(X). The von Neumann 
entropy also has a signficance for coding similar to the Shannon entropy: it 
is the average number of two-level quantum systems (or qubits) needed to 
faithfully represent one of the pure states of an ensemble described by p'^ 

^^'^V Then 



Suppose that systems R and Q are in a pure entangled state 
S{p^^) = 0. However, unlike the classical Shannon entropy, it is possible 
for the von Neumann entropy of the subsystems R and Q to be non-zero 
even when the entropy of the joint system RQ is zero. We saw above that 
the density operators p'^ and p^ have the same non-zero eigenvalues. Thus, 
S{p^) = S{p^). That is, if a pair of quantum systems are in a pure entangled 
state, the reduced mixed states will have the same von Neumann entropy. 

The von Neumann entropy has a number of important properties (usefully 
reviewed in [Q). Suppose A and B are quantum systems with joint state 
p"^^ and reduced states p^ and p^ . Then 

S{p^^) < S{p^) + S{p^) (6) 
S{p^^) > S{p^)-S{p^). (7) 

Equation ^ is the suhadditivity property of the von Neumann entropy, and 
Equation |^ is sometimes called the "triangle inequality" for the entropy func- 
tional. 

Another useful property of the von Neumann entropy relates it to the 
Shannon entropy of the probability distribution for the measurement out- 
comes of a complete observable. Let p be a mixed state with eigenvalues A^, 
so that 

P = '^^k \ '^k) (Afcl . 
k 

Now imagine that a measurement is performed of some complete ordinary 
observable, that is, the state is resolved using an orthonormal basis \aj). The 
probability pj that the jth outcome is obtained is thus 

= Afc (g,- |Afc ) (Afc |a,- ) 

k 

= J^MjkXk. 

k 

The matrix Vjk = {aj \Xk) is unitary, so the matrix Mjk = \Vjk\'^ is doubly- 
stochastic. That is, the rows and columns of Vjk are orthonormal vectors, so 
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that the rows and columns of Mjk all sum to one: 

^ Mij = 1 for all j 

i 

= 1 for all i. 

j 

It is a standard theorem of information theory that the Shannon entropy 
H{q) = —J^iQi^ogQi cannot decrease if the probabilities Qi are changed via 
a doubly-stochastic matrix |T^. Therefore, 

H{p)>H{X) = S{p). (8) 

The von Neumann entropy is thus a lower bound on the Shannon entropy 
for the outcome of a complete measurement on the system. 



4 Entanglement fidelity 



4.1 Definition 

Suppose that an entangled state "^^^"j is prepared for the joint system RQ, 

and that Q is subjected to a dynamical evolution described by S*^ (so that 
the overall evolution is given by (g) $*^). The final state is 



The fidelity of this process is 



= Tr 



^RQ\/^RQ 



P 



RQ' 



^RQ 



P 



RQ' 



^RQ 



We call Ff. the entanglement fidelity of the process. 

Written in these terms, F^ depends on the initial and final states of the 
system RQ. We will next show that Fe depends only on the map %^ and the 
initial reduced state p*^ obtained by partial trace: 



P 



Tr 



R 



^,rq\Urq 



That is, the entanglement fidelity Fe, which is associated with an entangled 
state including Q, is (rather surprisingly) a property intrinsic to the system 
Q itself. 



13 



The superoperator I"^ (E) $^ can be expressed 



Suppose that the initial states vl/f^^ and '^2/1 both purifications of p*^, 

lead to final states pf^ and p^*^ , respectively, under the action of the su- 
peroperator ® S*^; and let be the unitary operator for R such that 

v|/^«) = ([/«®lQ)|M/fQ). 
Clearly, ® 1^ commutes with l'^ ® A'^ for all p. Therefore, 



?7 



(9) 



(Note that equation ^ implies that pf^ and p^*^ must have the same eigen- 
values. This will be important later in the definition of entropy production.) 
From equation ^ it follows that 



e2 



pr 



RQ 



^RQ 
Fel- 



pf^' 



RQ 



Hence, the fidelity does not depend on which purification for p*^ is chosen. 
It only depends on and the superoperator S*^. 



4.2 Intrinsic expression for Fg 

It is instructive to derive an expression for Fg in terms of things that are in- 
trinsic to the system Q — i.e., an expression that does not refer to R. Suppose 
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we have an operator-sum representation for $^ , as in Equation 0. Consider 
a particular pure entangled state for RQ 



R 



where the 

the 
The 



k^J are orthonormal states in Hr. (We do not need to require 

(/)^^ to be orthonormal.) This state evolves under I"^ C?) into p^'^' . 
initial state of Q is 

Q 



P 



Tr 



R 



Now, for any operator X'^ acting on Tiq, 



:R 



1' 



jk 
jk 



XQ 



k 

We can now work out the fidelity very easily: 



XQ 



Fe = E(Trp'^A?)(Trp«A?^ 



(10) 



Although this is written with respect to a particular operator-sum represen- 
tation of $^ (which is not unique), the value of Fg will clearly be independent 
of this representation. Equation |TD| expresses Fg entirely in terms of the initial 
state p*^ of the system Q and the evolution superoperator $*^. 



4.3 Relations to other fidelities 

It is worth noting what is not. It is not the simple fidelity of the input 
and output states of Q. This fidelity can be written F{p^ , p^ ), where p^ = 
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$'^(^pQy We can show that Fe ^ F{p'^,p'^') in general by considering an 
operation defined by 



for some orthonormal basis /i'^y. The efi^ect of the operation is to completely 
destroy any coherences between different elements of the basis. That is, the 
superposition p^ \ would be transformed into the mixed state 



Now suppose = J2fi 



p-^ Hp 



. Then p'^' = p^ and thus F{p^ ,p^') 



However, let ^!^^ \ be a purification of p^ , for example 



p- 



The action of the superoperator I 



R 



on this state yields 



-UK 



If more than one of the A^^'s is non-zero, then Fe — F{p^^ , p^^') ^ 1. Thus, 
However, there is a general relation between F^ and F{p'^ ^p^'). 



Fe = F(p^«,p^«') < F{pQ,pQ'). 



(11) 



The entanglement fidelity F^ is thus a lower bound to the "input-output" 
fidelity F{p^,p^') for states of Q. 

Fe and F{p'^,p'^ ) do sometimes agree. Suppose that the initial state p*^ 
is in fact a pure state of Q, so that there is no entanglement between R and 
Q. Then, letting p'^ = , 
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The entanglement fidelity equals the "input-output" fidelity when the input 
state is a pure state. 

Now suppose that is a mixed state of Q arising from an ensemble S in 
which the pure state '\\)^^ occurs with probability ■pi. The average "input- 
output" fidelity for this ensemble is 



lQ 



4 



Q' 



where pf ^$'^{i;f)Uf). 



It turns out that F > F^,. Some such connection is reasonable physically, 
since we can "realize" a pure state ensemble £ by means of an /^-measurement 
on a purification of , and this measurement may be performed either before 
or after the dynamical evolution given by $*^. A full proof follows: 



Let 



a 



R 



be an orthonormal set in Tiji (assumed to have as many dimen- 



sions as there are elements in the ensemble f ), and let 



a. 



R 



basis is the basis in 



•qjRQj jg clearly a purification of p*^, and the 
which, when measured, generates the ensemble 8 as an ensemble of relative 

a? 



R 



states in Q. That is, ^/pi\'^l'^ 
Now consider the operator r-^*^ given by 

= E(i''®K)('*?|)( 



\^RQ^^ which we could also write as 



a. 



R 



a 



1«) 



Since r^*^ is the sum of an orthogonal set of projections, it is itself a pro- 



jection operator onto some subspace of Hr ® Hq. 



^f^'^) itself is in this 
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subspace: 

YRQ q,RQ 



i 



Therefore, we have the operator inequahty T^"^ > 



This means 



that, for any vector 



RQ 



X 



yrq 



,RQ 



,RQ 



^,r.q\Ur.q 



X 



RQ 



> \x 

which in turn imphes that, for all positive operators X^^ , 

rjYpRQj^RQ > ^,RQ\/\^RQ = ("^^^ X^^ qt^Q) 



Let be the operators in an operator-sum representation of the evolu- 
tion superoperator $*^. Then 

j 

= 

j 



R 



R 



R 



(i"" ® (hf )(«f I ® 1"^) 1*'''^ 

^?){^?\) (l''®A?)v^|«f)®|^. 



q; 



R 



If p««' = $^ then 



= Tr 
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= EE (^?| k?> (^.1 {^2 1^?) («f 

= EEi'.(v'.V?K^>(^^KK^ 



k 

F. 



a 



R 



Thus, F > Fg, as we wished to show. The average "input-output" fidehty 
under the evolution superoperator for any ensemble of pure states with 
density operator p'^ is bounded below by the entanglement fidelity Fg. 



5 Entropy production 
5.1 Definition 

As was shown in Equation PI above, if vE'f'^) and vpf^) are two purifications 



of p^, and each is subjected to the same evolution superoperator I"^ ® $ , 
the resulting states pi and p2 will have exactly the same eigenvalues. 
Therefore, 

where S{p) is the von Neumann entropy of the density operator p. In other 
words, the entropy of the final joint state of RQ is independent of which 
purification is chosen. Again, rather surprisingly, we have a quantity that 
depends only on the initial state p^ and the evolution superoperator S*^; that 
is, we have a quantity that is intrinsic to Q. 

For a given p*^ and $*^, we therefore define the entropy production Se to 

be 

5e = -Trp^«'logp««' (12) 
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\^RQ\ jg some purification of ffi. 



where p^^' = 1^®$^ (I^RQ^^^^Oh and 

We will now derive an explicit expression for in terms of p'^ and 
Suppose we have an operator-sum representation for $^ , and we define 

(These are not normalized vectors in general.) Then 
pRQ' ^ 



R 



4)' 



Thus, the vectors ^^'^ j give us a pure state ensemble for p^^' . We can use 
these states to construct a purification for p^^' . Let us adjoin a system E 
whose Hilbert space T-Le has at least as many dimensions as the number of 
operators. Then the state 



r^RQE'\ ^^\^RQ' 



(where the p^J are an orthonormal set of E states) will be a purification for 



Since the state 



yRQE'X -g ^ p^j.g state, the reduced states 



.RQ' 



^RQE'\/r^RQE' 



will have exactly the same non-zero eigenvalues. Therefore, = S{p^'^'] 
S{p^'). We can write down the density operator p^': 



p^' = TrRQ|T^«^')(T^«^' 



That is, = E^. W^. 



p^)(v^ 



, where 
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In other words we have the following prescription. Let be a density 
operator with components (in some orthonormal basis) 



Then 



S{W). 



(13) 



(14) 



As explained in the Appendix, any two operator-sum representations for 
S*^ are related by a unitary matrix Ufj,^. This simply corresponds to the 
freedom to write the matrix W^,^ with respect to any basis (which obviously 
does not affect Se). Let = W^^ be the diagonal elements of W^i,. These 
would be the probabilities given the state W for a complete measurement 
using the basis that yields the matrix elements W^^- Therefore, H{P) > 
S{W). But we could, by choosing the unitary matrix that diagonalizes VF^i^, 
find a representation such that H{P) — S{W) . This yields another expression 
for Se. 



Se — min 



(15) 



where P^ = TrA^p^A'^^ and the minimum is taken over all operator-sum 

representations of S"^. 

For a given input state p^, there is a "diagonal" operator-sum represen- 
tation, in which W^i, is diagonal. In this representation, 

Tr A^p^A^^ ^0 for II y^u. 

If p^ — d~^l^ (the "maximally mixed" state), then this simply means 
that the various operators are orthogonal in the operator inner prod- 
uct {B, C) = Tr B^C. This diagonal representation is minimal, in the sense 
that no other operator-sum representation includes a smaller number of 
operators. 



21 



The evolution S*^ might in fact be due to unitary evolution of a larger 
system that includes an environment E, with E initially in a pure state and 
RQ initially in a pure entangled state. In this case the final state of RQE 
will be also be a pure state. Then S{p^ ) = S{p^^ ) = Sg. In other words, 
the entropy production S'gis just the entropy produced in the environment, 
if it is initially in a pure state. 

Note that the same would have been obtained if we ignored the ref- 
erence system R entirely and simply considered the unitary evolution of QE 
with an initial state p'^ for Q. The entropy produced in the environment 
does not depend on the dynamically isolated reference system R. 

0^) at 



The assumption that the environment is initially in a pure state 
first seems too restrictive. For example, we may wish to consider environ- 
ments that are initially in some thermal equilibrium state p^. However, we 
may imagine that the em ironment consists of a "near" environment E^ and 
a "far" environment Ef. The system Q only interacts with the near environ- 
ment En- The initial state of the full environment may be an entangled pure 
state, but the system Q will "see" a mixed state for 

To summarize, the entropy production Sg has the following properties: 

• S'e is a quantity intrinsic to the system Q, and can be defined entirely 
in terms of the initial state p'^ and the superoperator S*^. 

• If the initial state p^ arises because a larger system RQ is in a pure 
entangled state, and if the reference system R has trivial dynamics, 
then the entropy production Se is the entropy of the final state p^*^ of 
RQ. (It is easy to generahze this to the case when R itself can have 
arbitrary unitary evolution — i.e., when R is dynamically isolated but 
may have a non-zero internal Hamiltonian.) 

• If the non-unitary evolution of Q arises because Q interacts with an 
environment E that is initially in a pure state, then is the entropy 
of the final state p^ of the environment. 

• If the initial state p^ of the system Q is a pure state, we can adopt a 
unitary representation for S*^ in which E is also initially in a pure state. 
Then p'^ and p^ have the same eigenvalues. In this case, Sg — S{p'^ ), 
the entropy produced in the system Q. 



22 



5.2 Relation to other entropies 

Once again, it is useful to emphasize what Sg is not. It is not in general the 
increase in the entropy of the system Q — in fact, this entropy may actually 
decrease, wheras Se is never negative. It is also not always the entropy 
increase of the environment, if the initial environment state is mixed. The 
entropy production Se characterizes the information exchange between the 
system Q and the external world during the evolution given by S*^. 

There are, however, inequalities relating Se to entropy changes in Q and 
E. First we will relate the entropy production to changes in the entropy of 
Q. Suppose an evolution superoperator is given, together with an initial 
state of Q. We can always find a representation for as a unitary 

for the 



evolution on a larger system QE with an initial pure state 
environment system. With this representation, the entropy of the joint initial 
state S{p'^^) = S{p^). The joint system QE evolves unitarily, so the entropy 
of the joint state remains unchanged. Thus, S{p^^ ) = S{p'^). The entropy 
production in this case is the final entropy of the environment S{p^ ). The 
triangle inequality (equation |^ yields 

Sip^) > Sip^')-Sip^') 

Se > S{p'^')-S{p'^). (16) 

In other words, the entropy production is no less than the increase in entropy 
of the system Q. We can also in this way establish that 

5e<5(p«) + 5(p«'). (17) 

Now we relate Se to the entropy change in the environment. In this case, 
we are given a particular (possibly mixed) initial state p^ for the environment 
and a particular unitary evolution U'°^^ for the joint system QE. Again, the 
initial state of Q is p^, but now we will imagine that this is a partial state of 
a pure entangled state "^^^^^ where R is an isolated reference system. The 
entropy of the joint system RQE is initially S{p^'^^) = S{p^), and remains 
unchanged during the unitary evolution of the joint system. By definition, 
the entropy production is just the entropy S{p^'^ ) of the final state of RQ. 
Thus, 

Sip'') > Sip^')-Sip^^') 

Se > Sip^^-Sip"^), (18) 
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so that the entropy production is no less than the increase in the entropy of 
the environment. We can also derive 



Se < Sip"") + S{p' 



(19) 



which, for a large environment, is probably not very useful. 

Similar arguments based on the subaddtivity of the entropy functional. 
Equation |^, also demonstrate that Sg is no smaller than the entropy decrease 
in either the system Q or the environment E. To summarize the lower bounds 
for Sf., 



Se > AS 

where A 5"^ and AS^ are the changes in entropy of the system Q and envi- 
ronment E, respectively. 



5.3 Entropy production and eavesdropping 



There is a simple application of these ideas to quantum cryptography [IC 
Suppose Alice prepares the state of Q with probability pk, and then 
conveys the system Q to Bob as part of a quantum cryptographic protocol. 
(Alternatively, we could imagine that Alice prepares Q in a state entangled 
with a system R, which she retains, as part of an entanglement-based protocol 
[0. But in such protocols, Alice usually later makes a measurement on R, 
giving rise to an ensemble of relative states of Q.) Along the way Q may 
interact with the rest of the world, represented by the environment system E, 
producing some level of "noise" in Q. The environment, however, may also 
contain the measuring apparatus of an eavesdropper Eve. We will assume 
that the environment is initially in a pure state (but see the remark above 
about the possibility of an entangled state of "near" and "far" zones within 
the environment). 

The dynamical evolution of Q is given by the evolution superoperator 
Let Se,k be the entropy production in Q for the input state p^, which 
equals the entropy of the final environment state pf resulting from the input 
of p^; and let 5'e be the entropy production associated with the "average" 
input state = J2kPkPk^ which equals the entropy of the average final 
environment state p^ . 
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The eavesdropper Eve will try to infer the preparation by examining 
the state of her measuring apparatus — that is, by trying to distinguish the 
various environment states pf . Denote Alice's preparation, and thus the final 
environment state produced by that preparation, by the random variable X 
and the reading on Eve's measuring apparatus by Y . Then a theorem of 
Kholevo [0 limits the mutual information I{X : y), which is the amount of 
information about X that Eve obtains from a knowledge of Y . This limit is 

I{X:Y) < S{p'^')-Y.PkS{p^k) 

k 

= Se-Y.PkSe,k (20) 
k 

< S,. (21) 

(If the eavesdropper Eve only has access to part of the environment system 
E, then she will be able to do no better, and I{X : Y) will still be bounded 
in this way.) 

Thus, the entropy production associated with the ensemble of input states 
and the evolution superoperator $^ , both of which can be determined in prin- 
ciple from repeated use of the channel Q, limits the amount of information 
that any eavesdropper might obtain about the input. Put another way, any 
process by which the eavesdropper obtains information about the channel 
system Q disturbs the system, leaving traces in the evolution superoperator 
$*^. The disturbance produced by the eavesdropper (and other interactions 
with the environment) is characterized by the entropy production Se- 



6 The quantum Fano inequality 
6.1 Classical theorem 

In classical information theory, there is a simple relation between the noise 



in a channel and probability of error in that channel |]T5|. This relation is 
Fano's inequality. We will derive an analogous quantum relation. 

Let X be a classical random variable representing the input of a noisy 
channel, and suppose that X can take on up to different values. The output 
of the noisy channel is represented by the random variable Y. The channel 
itself is represented by the conditional probabilities p{yk\xj) of an output 
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value Uk given an input value Xj. These probabilities, together with the 
input probability distribution p{xj), characterize the situation. The receiver 
makes an estimate X of the input X based only on the channel output Y. 
The probability of error Pe is the total likelihood that X X. 
Fano's inequality (in its stronger form) states that 

HPe) + Pe log(iV - 1) > H{X\Y) (22) 

where h{PE) = — FelogPE — (1 — Pe) logFj; and H{X\Y) is the Shannon 
conditional entropy of X given Y. H{X\Y), the average residual information 
uncertainty about the input given the output, is a measure of the noise in 
the channel. H{X\Y) = for a noiseless channel, in which the input X can 
be exactly determined by the output Y. Noting that H^Pe) < 1 (since our 
logarithms are base 2), we can derive a simpler but slightly weaker form of 
Fano's inequality. 

1 + PE\ogN > H{X\Y). (23) 

Fano's inequality is used to prove the "weak converse" of the classical noisy 
coding theorem, which states that information cannot be sent at a rate 
greater than the channel capacity with arbitrarily low probability of error 



6.2 Quantum theorem 

We now turn to the quantum problem. As before, we suppose that the system 
RQ is initially in the entangled state vE'-^'^V and that Q is subjected to an 



evolution described by . The reference system R is isolated and has trivial 

dynamics described by I^. The dimensions of Tig and Tipi are both finite 

and equal to d. After the evolution, the system is described by a joint state 
pRQ\ 

Now suppose that we subject the final state p^*^' to a measurement of 
a complete ordinary observable on the system RQ, which is described by a 
basis of (P orthogonal states for RQ. Let the random variable X represent 
the outcome of this measurement. Then we know (from Equation |^) that 

S, = 5(p^«') < H{X). 

Further suppose that one of these basis vectors is chosen to be the original 
state ^'^'3). Then the fidehty = (^'^'^ p^'^' '^^'^) is just the probability 
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of this outcome. Given this probabihty, the largest possible value of H{X) 
would occur when all of the cP — 1 other outcomes have equal probability. 
Then 



max H{X) 



FelogF,-((i2-i)l_^ 

Fel0gFe-(l-Fe)l0g(l 




F,) + (l-Fe)log(d2-l). 



Therefore we can conclude that 



h{Fe) + {I - F,)\og{d^ 



1) > Se. 



(24) 



This is our quantum version of the Fano inequality, relating the entanglement 
fidelity with the entropy production Se- Although we have made use of the 
reference system R in deriving this inequality, both F^ and 5*6 have meanings 
that are intrinsic to the system Q. 

As before, we can give a slightly weaker form of the inequality: 



It is instructive to compare the form of this equation to that of equation 
p3| . The number of possible input states is analogous the dimension d of 
Tiq. The probability of error Pe roughly corresponds 1 — Fe, the amount 
by which the final entangled state fails to correspond to the initial one. The 
noise term H{X\Y) is replaced by the entropy production S^- Finally, a 
factor of 2 appears in the error term in the quantum case — which in fact 
corresponds to replacing A by li^, the dimension of Tiq ® Hr. 

We can strengthen the quantum Fano inequality in a number of ways. 
First, if the reference system R has a Hilbert space of dimension da < d, the 
quantity d"^ can be replaced by the product dud. The required dimension dR 
is in fact just the dimension of the subspace that supports p^, and so dR < d 
even if R is much larger than Q. Since we wish to consider F^ and Se to be 
quantities intrinsic to Q, though, we will simply adopt dR = d. 

Finally, we note that the fidelity F^ can be lowered by internal dynamics 
of Q as well as by information exchange with the environment. To take this 
into account, we could allow the final state of the system to be "processed" 
via any unitary transformation U'^ on Q, and define 



1 + 2(1- Fe) log d>Se. 



(25) 



= max 



(26) 
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(Fe is also independent of the particular purification for p*^, and is thus an 
quantity intrinsic to Q.) Clearly Fe > Fg. A derivation very similar to the 
one we have given allows us to replace F^ by F^ in equation obtaining 



M^e) + (1 - Fe) l0g(c/2 - 1) > Se (27) 

l + 2(l-Fe)logd > Se. (28) 

We could further extend this by allowing Q to be subjected to a second 
arbitrary completely positive map after , and obtain a similar relation. 
However, in this case the relevant entropy production would be that due 
to the total evolution, both S*^ and the subsequent "processing". Since it 
is possible that Se < Se, we do not obtain a useful general relation. (This 
is precisely what happens in quantum error-correcting codes, as explained 
below.) 



7 Remarks 

One possible application of entanglement fidelity and entropy production is 



in the study of non-ideal quantum computers [|19]. In a typical state of a 
quantum computer, the different parts of the computer are in a highly en- 
tangled state. The elements of the computer's memory must maintain their 
states in such a fashion that this entanglement is preserved. The consider- 
ations in these notes are thus particularly suited to studying the effects of 
noise and decoherence in this context. 

What we have found is that the capability of a system Q to preserve its 
entanglement with some other system R can be determined from the initial 
state and the dynamics of Q itself. Destruction or distortion of entanglement, 
and information exchange with the environment, leave distinct traces in the 
dynamics of the system itself. We can characterize these by the entanglement 
fidelity F^, and the entropy production Se- 

Fe is properly thought of, not as the fidelity of one state with another 
(though it can be given that interpretation by including a reference system 
R), but as the fidelity of a process given by the input state p'^ and the system 
dynamics S*^. F^ does not just measure how well the state of Q is preserved 
by , but also how coherently. If the input state is a pure state, these 
amount to the same thing; but otherwise, F^ is a stronger measure of the 
amount of disturbance the state experiences. 
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Se is also properly thought of, not as the entropy of some state, but 
as the entropy associated with the dynamical process given by p*^ and $*^. 
Information exchange with the environment, even if it does not change the 
entropy of either the system Q or the environment E, can lead to non-zero 
entropy production Sg. Entropy production is therefore a clearer measure of 
this exchange than the changes in entropy of either system. 

The relationship between and Se amounts to a quantum Fano in- 
equality, connecting the information exchange with the environment to the 
disturbance of the state. This illustrates very clearly a general principle: In 
quantum information theory, noise is exactly information exchange with an 
external system. In a classical system, information can be "leaked" into the 
environment with arbitrarily little disturbance to he system — the environ- 
ment can simply make a copy of the information, leaving the original intact 
within the system. But quantum information cannot be copied. Any de- 
parture of information into the environment necessarily yields an irreducible 
disturbance of the system. (This is the fundamental idea behind quantum 
cryptography.) The departing information leaves its "footprints" behind in 
the entropy production Se and associated imperfect entanglement fidelity Fg. 

These ideas shed an interesting light on the recently discovered quan- 
tum error-correcting codes 0. In these codes, input quantum states are 
represented by massively entangled states of a system Q composed of many 
qubits: Q = Qi - ■ ■ Qn- The environment is assumed to act independently 
on these systems, which in our language corresponds to the requirement that 
the evolution superoperator for the system Q factorizes: 

$Q = $«i ® ...®$'?^ 

The resulting state is then subjected to a second process, which typically 
involves an incomplete measurement on Q followed by a unitary evolution 
(which depends on the measurement result). Under certain circumstances, 
the original state of the system may be restored with very high fidelity. 

The action of the channel and the subsequent restoration process of the 
sequence of qubits can be written as a single superoperator for Qi - ■ - Qn- 
Since the fidelity of this combined process is high, we can conclude, rather 
surprisingly, that the total entropy production is quite low. At first this 
seems paradoxical, since the individual entropy productions of the "noise" 
process and the restoration measurement may both be high. 
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But this is not too difficult to understand. Let E represent the environ- 
ment system that interacts with the qubits during the "noise" stage, and let 
M represent the apparatus that performs the restoration process. To begin 
with, we might imagine that E and M are in pure states. After Q interacts 
with E (and thus exchanges information), the state of QE becomes entan- 
gled. In the second stage, M interacts and exchanges information with Q, 
and the entanglement of Q with the rest of the world is reduced — it is passed 
to M. At the end of the process, both Q and the "rest of the world" EM 
are in near-pure states, but E and M have now become entangled. 

Thus, the process of quantum error-correction can be thought of as a 
process of passing entanglement (produced by a previous interaction with the 
environment) to the apparatus, in such a way that the entropy production 
for the total process (noise followed by restoration) on Q is very low. If Se 
is very low, then the overall dynamics for Q is nearly unitary, so that the 
original state of Q can be approximately recovered. It is not yet known under 
what general circumstances, and to what fidelity, this can be accomplished. 
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Appendix: Representation theorems 
A.l Index states and relative states 

In this appendix we will use some of the ideas from the main paper to 
show that any trace-preserving, completely positve linear map has both an 
operator-sum representation and a unitary representation. This derivation is 
somewhat more direct than that found in 0. We will also suggest a useful 
characterization of all such representations. 
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Suppose R and Q are quantum systems with dimTi/j = dim Tig = d, and 



a§) and 



(3^) be orthonormal basis vectors for Hr and Hq. We can 



let 

write down a "maximally entangled" pure state of RQ: 



x^RQ 



1 



Q 



It will be convenient to consider instead the non-normalized vector 



(Using rather than ^!^^\ will eliminate some factors of \/d in our 



expressions.) 

For every state C,^) of i? there is a unique state such that 



1 

7^ 



^RQ 



C^) and 



The relation between 
^'^^ the relative state in Q to 
that yields C^). 



is a one-to-one correspondence. We call 
C^), and we call the index state in i? 



Given a state 



, let us denote the associated index state in R by 



*R 



We can give a simple prescription for finding 

k 

Then 



from 



Suppose 



E 



Ci. \a 



R 

k I ) 



as can be easily seen: 



i*R 



a 



R 



kl 

k 



a 



R 



Pi 



Q 
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It is also clear that 



RQ 



a relation that will be useful 
The function that takes 

f ), then 



ater on. 
to 



^Ms conjugate linear. If 



ai 



*R 
*R 



Oi 



+ 02 



A. 2 Operator-sum representations 

Let S*^ be the trace-preserving, completely positive linear map that describes 
the dynamical evolution of the system Q. Since $^ is completely positive, 
any trivial extension of it is positive; in particular, the superoperator I^(g)$*^ 
is positive. Thus, the state 



P 



RQ' 



is a positive operator, as is 



V 



(^^RQ'j(^-q,RQ 



Of course, p^^' has unit trace, so it is a normalized density operator, while 
Tr D^'^' = d. 

The operation of realizing a state of Q via choosing an index state of R 



commutes with the dynamical operation given by eg) In other words 



to 



if we wish to write down the final state p^' 

we can cither apply the index state 

else we can apply the extended superoperator I 
then apply the index state, thus: 



p^), where p*^ = (p^ji^cj)'^ 
^'^'5^ and then apply $*^, or 
S'^ to the joint state and 



P 



9' 



k*R 



jjRQ' 



k*R 
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This makes sense on physical grounds. A measurement of an observable on 
R involves a completely different system than the dynamical evolution of Q, 
and the two operations might take place arbitrarily far apart. The time order 
of the two should irrelevant to the result. 

A more formal argument runs as follows. Let be the superopera- 
tor (i.e., a linear map on operators on I-Lr) associated with multiplication 
on both sides. That is, if is an operator on TYr, then 
rj,R The superoperator $^ ® l'^ (which is 



*R 



L*R 



by 

$«(T^) 

just multiplication on both sides by 
with the dynamical superoperator I"^ 

$^ (<l>^ (g) I 

■ ((U* 



obviously commutes 
^. Therefore, 



iR 





(^^RQ 


)) 


^RQ\^ 


^^RQ 


)) 



*R 



i*R 



L*R 



L*R 



iQ^ ^RQ 



k*R 



k*R 



From this we can see that 
p^' = $^ ( 



as we wished to show. 

The operator D^^' is positive; thus, we can find a set of vectors 
such that 



^RQ' 



These vectors, for example, might be constructed from the eigenvectors of 
£)RQ ^ normalized by their eigenvalues; but there are many such decomposi- 
tions. In fact, it is easy to see that the 

the representation of p^' by an ensemb' 
a representation 



nRQ'j vectors are simply related to 
e of pure states. That is, given such 



RQ' 
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we can simply set ^^^'^ = ^Jp^ V'^'^'^ 

It is also clear that there is a decomposition of D^'^' with no more than 
(P vectors fl^^'^, since the dimension of the space Hr (8> Hq is (P. 

Here comes the essential trick. Define the operator by 



4 



for each state 



and 



L*R 



Hq. Furthermore, 



of Q. Because of the conjugate linear relation between 
, each thus defined is a perfectly good linear operator on 



E 



k*R 



j,RQ')/~^RQ' 



k*R 



k*R 



jjRQ' 



k*R 



We have thus derived an operator-sum representation for the completely 
positive map for all pure input states . Extending this to mixed 

state inputs is trivial, of course, since every mixed state is a linear (convex) 
combination of pure states. We can ftirthcr see that each completely positive 
map has an operator-sum representation with no more than d? terms. 
We also find that, for our operator-sum representation for S*^, 



E 



IV E^? ^""W 



= Trp«' 
= 1 



since S*^ is trace-preserving by assumption. Since this is true for all states 
0*5 V including the eigenstates of the positive operator X^^A^^A^, we con- 
clude that 
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A. 3 Unitary representations 

Having derived an operator-sum representation for $^ , it is easy to arrive at 
a unitary representation. Add an extra quantum system E and write down 
a purification T^'^^' \ for D^Q' as follows: 



fRQE'\j2\~^RQ' 



for an orthonormal set of vectors e^J in He- (Again, finding a purification 

for D^' is equivalent to finding a purification for but it is slightly 

easier to work with the non- normalized states.) We note that we require no 
more than dimensions in Ti^ to construct this purification, since there are 



Fix some state 



decompositions of D^"^' with no more than cP vectors 
0^^ of E. We can define an operator U'^^ on a subspace of Hq ® T^e by 

C/«^(|(/)«)® |o^)) 



~^RQ' 



for all 
and re 



in I-Lq. Once again, the conjugate linear relation of index state 
ative state guarantees that this is a linear operator. Furthermore, 



given two states 0^) and 0^), 



QE' 



QE' 



'■^RQE' 

- E 



aQ^ aQ 
aQ^ aQ 



■^RQE' 



9\ I Si 



The operator [/'^■^ preserves inner products on this subspace of states; it can 
therefore be extended to a unitary operator on the entire space Tig ® Tig. 
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Thus, we have a unitary representation for S'^: 



Once again, we can extend this unitary representation to mixed state inputs, 
since these are hnear (convex) combinations of pure states. 



A. 4 Remarks 

In the above arguments, we arrived at an operator-sum representation for 
S*^ by a decomposition of D^^' , that is, by a pure state ensemble for p^^' . 
It is also easy to see that every operator-sum representation for $*^, when 
extended and applied to ^f^'^j, will yield such a decomposition. (Simply 

define jl^^'^ — (1^ ® A^) ^f^^^) Thus, the operator-sum representations 
for S*^ are in a one-to-one correspondence with the pure state ensembles for 

pRQ' 

Similarly, wc obtained a unitary representation for $^ by finding a purifi- 
cation for D^'^ , or equivalently, for p^^ . But every unitary representation 
will be associated with such a purification, because the initial total state 



O^j of RQE will evolve unitarily to a pure state, from which the 

state /9^*^' is obtained by a partial trace over E. Now, any such purification 
of p^'^ can be obtained from any other by means of a unitary transformation 
that acts on T-Ce, which corresponds to an internal rotation of the environ- 
ment system E that acts after the interaction of Q and E. 

The non-uniqueness of the operator-sum representation and the unitary 
representations are related, since every pure state ensemble for p^*^ can 
be realized by fixing a purification f^^^'^j and choosing a complete ordi- 
nary measurement for E (i.e., an orthonormal basis for TYg). Equivalently, 
we might fix a measurement basis for T-Ce and a particular purification. A 
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change of representation in each case will be associated with a unitary matrix 
corresponding to a rotation in TIe- That is, suppose that for all p*^, 

so that the and the B'^ operators both form operator-sum representations 
for $*^. Then there is a unitary matrix lJ^a, so that 

V 

(Note that we may have to extend one operator-sum representation by a 
finite number of zero operators so that the two representations have the 

same number of operators.) The matrix IJ^i, is in fact the matrix that relates 
two different bases in corresponding to two purifications related, in the 
sense outlined above, to the two operator-sum representations. 
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